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Abstract 

In 1916 Einstein introduced the first rules for a quantum theory of electromagnetic radiation, 
and he applied them to a model of matter in thermal equilibrium with radiation to derive Planck's 
black-body formula. Einstein's treatment is extended here to time-dependent stochastic variables, 
which leads to a master equation for the probability distribution that describes the irreversible ap- 
proach of Einstein's model towards thermal equilibrium, and elucidates aspects of the foundation 
of statistical mechanics. An analytic solution of this equation is obtained in the Fokker-Planck 
approximation which is in excellent agreement with numerical results. At equilibrium, it is shown 
that the probability distribution is proportional to the total number of microstates for a given 
configuration, in accordance with Boltzmann's fundamental postulate of equal a priori probabil- 
ities for these states. While the counting of these configurations depends on particle statistics- 
Boltzmann, Bose-Einstein, or Fermi-Dirac - the corresponding probability is determined here by 
the dynamics which are embodied in the form of Einstein's quantum transition probabilities for the 
emission and absorption of radiation. In a special limit, it is shown that the photons in Einstein's 
model can act as a thermal bath for the evolution of the atoms towards the canonical equilibrium 
distribution of Gibbs. In this limit, the present model is mathematically equivalent to an extended 
version of the Ehrenfests' "dog-flea" model, which has been discussed recently in this journal by 
Ambegaokar and Clerk. 
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Introduction 

In a seminal paper written in 1877, Boltzmannjl] formulated the basic principle of sta- 
tistical mechanics: in equilibrium all of the microstates of an isolated system that have the 
same total energy occur with equal a priori probability. As a consequence of this princi- 
ple, the probability for a given macroscopic configuration is proportional to the accessible 
number of microscopic states which comprises it, and Boltzmann demonstrated that the 
thermodynamic entropy is proportional to the logarithm of the maximum value of this num- 
ber of configurations. Boltzmann's principle is often regarded as a necessary postulate from 
which other concepts of statistical mechanics and its relationship to thermodynamics can be 
deduced [2j. In 1900 Planck made a fundamental application of this postulate in deriving 
his famous black-body radiation formula 3]. Planck considered the source of the radiation 
to be Hertzian electromagnetic oscillators of frequency z/, but he introduced the radical as- 
sumption that the energies of these oscillators were quantized in units of an energy element 
e = hu, where h is Planck's constant. This assumption yields a finite and countable num- 
ber of microscopic configurations of fixed energy for which Boltzmann's statistical postulate 
could be readily applied Then in 1916 Einstein developed a different approach in de- 
scribing the condition for the thermal equilibrium of radiation and matter which lead him 
also to a derivation of Planck's black-body radiation formula [5] . Following Bohr's quantum 
rules for the atom, Einstein proposed a quantum theory for the emission and absorption 
of radiation, and he then combined it with a detailed balance argument to obtain Planck's 
,«-««. h thecal radiation Q. 

But why should these two completely different derivations, which have in common only 
Planck's quantum hypothesis that the energy of the source of radiation is discrete, and other- 
wise are based on different physical and mathematical assumptions, lead to the same result? 
Surprisingly, it appears that this question was not addressed in the past, and presently it 
is generally ignored in textbooks on statistical mechanics j2j. In this paper we propose to 
answer this question by considering a stochastic treatment of Einstein's model. It will be 
shown that the equilibrium probability distribution obtained this way is the same as the 
result obtained by applying Boltzmann's postulate of equal a priori probabilities for the 
microstates of a system composed of atoms and photons with fixed total energy. While the 
counting of these configurations depends on particle statistics, which can be Boltzmann, 
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Bose-Einstein, or Fermi-Dirac, the associated probability distribution is determined in our 
treatment by the dynamics which are embodied in the Einstein's transition probabilities for 
emission and absorption of radiation. We obtain also a time dependent master equation 
^1 that describes the irreversible approach of radiation and matter towards thermal equi- 
librium. In the Fokker-Planck approximation we obtain an analytic solution in excellent 
agreement with numerical results some of which are presented here. 

In section we present a historical account of Einstein's model for the thermal equilibrium 
of radiation with matter, and we describe the detailed balance argument which he used to 
derive Planck's formula for black-body radiation. In section II we extend this treatment 
by assuming that the variables in Einstein's model are stochastic variables, and we derive 
a probability function that describes the stationary equilibrium of this model. We show 
that this probability function is proportional to the number of configurations of the atoms 
and photons at fixed total energy, in accordance with Boltzmann's fundamental postulate of 
statistical mechanics and the symmetries based on quantum statistics. Thus, the counting 
associated with Bose-Einstein statistics which gives the probability distribution for photons 
in statistical mechanics [^| ^^|, is obtained here from the quantum dynamics embodied in 
Einstein's transition probabilies for the absorption and emission of photon by atoms. Like- 
wise, we obtain the corresponding results associated with Boltzmann's statistics for atoms 
that are treated as distinguishable particles, or with Fermi-Dirac statistics for atoms that 
satisfy Pauli's exclusion principle. In section III we obtain the most probable configuration 
by evaluating the maximum of the equilibrium probability function. This also corresponds 
to the maximum value of Boltzmann's entropy function, which is the justification in statis- 
tical mechanics of the second law of thermodynamics. In section IV we consider a master 
equation Q| for the probability distribution that describes the time evolution of Einstein's 
model when it is initially in an arbitrary non-equilibrium state, and we show that it always 
approaches a unique function which is the equilibrium probability obtained in section II. 
Defining an appropriate entropy function that increases monotonically in time ( a proof is 
given in Appendix A), we show that its maximum value determines the stationary or equi- 
librium probability. The time evolution and the approach to equilibrium of the probability 
function is also illustrated by numerical solutions of this master equation. In section V we 
approximate the master equation by a Fokker-Planck equation, and we obtain an analytic 
solution in the form of a Gaussian function with a time-dependent mean value and a width 
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parameter which is found to be in excellent agreement with our numerical solutions. Finally 
we consider a special limiting case where the photons act as a thermal bath for the atoms, 
which corresponds to an extension of a statistical model for the approach to thermal equi- 
librium by Paul and Tatiana Ehrenfest as extended recently by Ambegaokar and Clerk [ll| 
A summary and some conclusions are presented in section VI. 



I. Historical background: Einstein's quantum theory of radiation and its application 
to atoms and photons in thermal equilibrium 

In 1916 Einstein introduced a quantum theory for the emission and absorption of elec- 
tromagnetic radiation by atoms which anticipated the modern theory of quantum electro- 
dynamics, and he applied it to a derivation of Planck's black-body distribution for thermal 
radiation [5] . His model for matter in thermal equilibrium with radiation consisted of atoms 
or molecules with discrete energy levels, which exchange energy with electromagnetic ra- 
diation contained inside a cavity with reflecting walls. For simplicity we assume here that 
these atoms have only two levels with an energy difference e, and that the radiation has 
frequencies in the range v, v + dv. Instead of applying Maxwell's classical electromagnetic 
theory, Einstein assumed that the interaction of radiation with matter gives rise to quantum 
transitions between the energy levels of these atoms which are associated with the absorp- 
tion and emission of radiation. He introduced transition probabilities per unit time for the 
stimulated absorption and emission of radiation by an atom which are proportional to the 
electromagnetic energy density p v in the cavity, in analogy with the exchange of energy 
between an electromagnetic oscillator and radiation in classical theory. In addition, he in- 
troduced a probability for the spontaneous emission of radiation from an excited state of the 
atom independent of the radiation in the cavity, to take into account the classical radiation 
of a charged oscillator. Hence Einstein's absorption probability p a and emission probability 
p e have the form 



p a = B a p v 



(1) 



and 



p e = A + B e p v 



(2) 



4 



where B a and B e are undetermined coefficients for absorption and stimulated emission re- 
spectively, and A is the coefficient for spontaneous emission jf]]. 

Einstein' derivation of Planck's black-body formula proceeded as follows. He argued 
that in thermal equilibrium the average number n g of atoms in the ground state times the 
probability for absorbing radiation per unit time must be equal to the average number n e of 
atoms in the excited state times the probability for emitting radiation per unit time, which 
leads to the detailed balance equation 

P a n g = p e n e . (3) 

Next, he assumed that the atoms are in thermal equilibrium at a temperature T, and he 
invoked the canonical Gibbs distribution to determine the ratio 



n g 



e^ kT . (4) 



Substituting this relation into Eq. Eland using Eqs. ^ and El he obtain the following relation 
for the equilibrium thermal radiation (black-body) energy density function of the 

temperature T in the cavity : 

Pv = (B a e^ - B e ) (5) 
By 1900 it was known experimentally that for large temperatures and long wavelengths 
(small frequencies) the black-body radiation energy spectrum depends linearly on the tem- 
perature. At about the same time, by applying the equipartition theorem Rayleigh also 
pointed out |12| that 

p u = ju 2 kT, (6) 

where the constant 7 = 8n/c 3 was first calculated correctly by Jeans five years later . For 
T >> e/k, this limit is obtained from Eq. El provided that B a = B e = B, which yields the 
relation 

A/B 

P»- ( e e/kT_ 1 y V) 

At this point Einstein appealed to Wien's remarkable theoretical result that p v has a scaling 
dependence on the variables v and T (Wien's displacement law) of the form 

Pv = v 3 f(u/n (s) 



where / was an undetermined function. Comparing Wien's result with Eq|?l Einstein de- 
duced the frequency dependences of his two undetermined parameters 

^ = ov 3 (9) 

and 

e = hv, (10) 

where a and h are universal constants, and obtained Planck's black-body formula, r 

In this brilliant tour de force in which the probabilistic foundation of quantum theory 
was fist enunciated, Einstein not only derived Planck's formula, but through an independent 
route he also obtained the fundamental quantum relation, Eq. El between the frequency v 
of the emitted and absorbed radiation and the energy difference e between two atomic levels 
- a relation which had been introduced earlier by Planck and thirteen years later by Bohr. 
The constant h is of course Planck's famous constant, while the constant a = 8Trh/c 3 had 
also been obtained by Planck. This constant can also be obtained from the constant 7 in 
the Rayleigh- Jeans limit, Eq. |U1 which implies that a = / yh. This result was well known to 
Einstein, who had obtained this limit from a relation of Planck which he described in his 
famous 1905 paper on a "heuristic" view of light [14] , but now he commented only that to 
compute the numerical value of the constant a, one would have to have an exact theory of 
electrodynamics and mechanical processes" Q|. 

In his original model Einstein assumed that the atoms could move freely, and he also 
demonstrated that the momentum transfer by the absorbed and emitted radiation was given 
by hvjc along a direction "determined by 'chance' according to the present state of the 
theory" . In this manner Einstein abstracted the fundamental concept of photons of different 
frequencies as the quantum states of electromagnetic radiation "entirely from statistical 
mechanics considerations" 1^ . It also follows from these considerations that the number 
density n v of photons in a radiation field of frequency v and energy density p v is given 
by n v = p u /hv, although this relation was not stated explicitly in his paper. Einstein's 
remarkable "quantum hypothesis on the radiation exchange of energy " p was confirmed 
when the quantum theory of electromagnetic radiation was developed, giving an explicit 
expression for the coefficient of B, and showing that the ratio (A/ B)(l/hv) = 87rz/ 2 /c 3 
corresponds to the number of momentum states of the photons per unit frequency interval, 
as had been conjectured by Bose 



Since the quantum theory is invariant under time reversal, it may seem surprising that 
Einstein transition probabilities for the absorption and emission of radiation, Eqsffl an d [21 
are different, due to the extra contribution for spontaneous emission. But these probabilities 
are averages over the direction of momentum of the transition probabilities for microstates 
with photons of fixed momentum. In the quantum dipole approximation, the probability 
of emission of a photon with momentum p is proportional to n(p) + 1, where n(p) is the 
initial number of photons, while the probability for absorption with the same initial number 
of photons is proportional to n(p). When integrated over momenta, this yields Einstein's 
transition probabilities. For transitions between microstates, however, the proper compar- 
ison should be made by considering the absorption probability for n(p) + 1 photons in the 
initial state, in which case these transition probabilities are the same. 

II. Extension of Einstein's detailed balance argument to stochastic variables 

Even in thermal equilibrium, transitions associated with the absorption and emission of 
photons are occurring continuously, and therefore the number of atoms in the ground state 
n g and in the excited state, n e , as well as the number of photons n p in the radiation field 
must be consider to be stochastic variables which fluctuate in time. Hence the variables in 
Einstein's detailed balance equation, Eq. correspond to some "average" value of these 
quantities. In order to describe Einstein's model in further detail, we introduce a probability 
function P eq for the values of these stochastic variables. In accordance with the constraints 
of a fixed number of atoms n = n g + n e and a fixed total energy E = n p hv + n e e, we can 
express P eq as a function of a single integer k, where n g = k, n e = n — k, n p = n q — n + k, 
and n q = Ejhv. For n < n q , the range of k is < k < n, while for < n q < n, the 
corresponding range of k is n — n q < k < n. Then the probability that there are k atoms 
in the ground state, and that one of these absorbs a photon during the interval of time St is 
given by 

Q a (k) = k Pa (k)P eq (k)5t, (11) 
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while the corresponding probability that one of the n — k atoms in the excited state emits 
a photon is given by 

Q e (k) = (n - k)p e (k)P eq (k)5t. (12) 

Since n p = p v Vdv /hv, where V is the volume of the cavity, the basic transition probabilities 
for emission and absorption of photons, Eqs. ^ and can also be expressed in terms of the 
number of photons n p in the cavity by 

p a {k) = B' a n p (13) 

and 

p e (k) = B' e (g + n p ) (14) 

where B' a = B a hi//Vdu, B' e = B e hv/Vdv, and g = / c")Vu 2 dv is the number of photon 
momentum states of frequency v in an interval dv inside a cavity of volume V. 

The condition for thermal equilibrium requires that a configuration of the system having 
n e = n — k atoms in the excited state have the same probability Q e (k) to emit a photon 
during any time interval St as the probability Q a (k + 1) that a configuration with n g = k + 1 
atoms in the ground state absorb a photon during this time interval. This requirement 
implies the extended detailed balance relation 

Q a (k + l)=Q e (k) (15) 

It can be shown that if one neglects the correlations between the number of atoms and 
the number of photons in a given state, Einstein's detailed balance relation, Eq. |3J can be 
recovered by summing both sides of Eq. E3over k, where the quantities n g ,n e and n g now 
refer to averages over the distribution P eq (k). 

We now proceed to solve this extended detailed balance equation for P eq {k) by substitut- 
ing Eqs. Uni and HU for p a and p e respectively in Eqs. [TT] and H2J leading to the recurrence 
relation, 

(I (n - k)p e (k) B' e (n-k)(g + n p ) 

Peq[k (k + l)p a (k + l) P ^ k) ~ B> a {k + l)(n p + 1) P ^ k) - (16) 

This relation can be readily solved for the equilibrium distribution P eq (k), and we obtain 



B 



Pe q (k) = (^) k n a (k)n p (k)x, (17) 



B 



where 



and 



V a (k) = (18) 



n g \n e . 



where n g = k, n e = n — k, and n p = n + k, with n Q = n q — n. We see that fl a {k) is the 
well-known expression for the number of configurations for the atoms according to Boltz- 
mann's statistics (distinguishable particles), while Q p is the corresponding expression for the 
number of configurations of photons according to Bose-Einstein statistics (indistinguishable 
particles). The constant \ is a normalization factor given by the condition ^2,P{k) = 1, 
which yields 

B' 



^ = T,(w )kQa{k)Qp{k) (20) 



k 

Evidently, to recover Boltzmann's postulate it is also necessary that B a = B e . Previously 
Einstein required this condition to derive Planck's black-body formula, but subsequently it 
was show to follow directly from quantum electrodynamics. 

If the atoms in this model behave like fermions, we must include the effect of the Pauli 
exclusion principle in the probability expressions, Eqs. ^2 and El Introducing the variables 
g g and g e for the number of degenerate ground states and excited states of the atom, we 
now have 

Q F a (k) = k(g e -n+ k) Pa (k)P e F q (k)6t } (21) 

and 

Qf (*) = (n - k)(g g - k)p e (k)P e F q (k)5t, (22) 
and we obtain the recurrence relation 



P F (k + 1)- B' e (g g -k)(n-k)(g + n p ) F 
eqi + } " B' a (g e -n + k + l)(k + l)(n p + iy^ kj - 

This relation implies that 



Q F (k) = ^ — (24) 

a{ ] (g 9 -k)\ki(g e -n + k)!(n-k)V ^ 

which is the expression for the number of configurations which have k atoms injure ground 

state and n — k atoms in the excited state in the case of Fermi-Dirac statistics 



III. Computation of the most probable configuration in thermal equilibrium 



At equilibrium, the most probable configuration of a system occurs at the maximum 
value of P eq (k), Eq. For large values of n,n e ,n p and g, the Stirling approximation for 
the factorial in Eqs. ITH1 and fEU yields the relations 



InttlJk)) « -n p-lnp*-) + —ln{—)\ (25) 
n n n n 

and 

ln(Q p (k)) « n p [(1 + ^-)ln(l + — ) - — /n(— )]. (26) 

Setting ln(P eg (k)) = ln(ft a (k)) + ln(ft p (k)) + ln(x), we obtain the maximum value for P eq (k) 
in this approximation by the condition dln(P eq (k)) / dk = which implies 

dln(n a (k)) dln{%{k)) _ 

dk + dk " U ' {Zi) 

where 

awnjw = (28) 

and 

dln(Q p (k)) _ + x) 



This condition leads to the relation 



n 9 9 



■=*■ = ■*- + !, (30) 



where n 5 = k m , n e = n — k m , and n p = n a + k m , which gives a quadratic equation for the 
most probable value k m of k: 

k m = ^[(n~2n - g±y / (n- 2n Q - g) 2 + 8n(g + n )}. (31) 

The appropriate sign for the square root in this solution is determined by the condition that 
the most probable number n g = k m of atoms in the ground state, and the most probable 
number of photons n p = n + k m must both be positive. Since the right hand side of Eq. 
I3TI1 is greater than one, it is convenient to parameterize this solution by setting n g /n e = 

10 



g/n p + 1 = e A where A is a positive number. Moreover, in accordance with statistical 
mechanics, we recognize that we can set A = e/fc^T, where T can be identified as the 
equilibrium temperature of the cavity and k% as the Boltzmann constant. Notice that in 
this dynamical treatment, T is a positive parameter which depends on the value of the 
constants n,n and g, and we recover from first principles Einstein relations, Eqs. 0]and[7l 
in the form 



L J_ = p e/k B T 

7 

and 



e e ' kBT (32) 

n r . 



n, 



g 



(33) 



P (^ e hv/kT _ \\ 

for the most probable values of the random variables n g ,n e and n p . 

At this point, it is tempting to identify the ratios k m /n = 1/Z a and (n — k m )/n = 
e~ e ' kBT jZ a , where Z a = 1 + e _e//fcsT , with the the canonical probabilities introduced by 
Gibbs [l6j atoms in equilibrium with a thermal bath to be in the ground state and excited 
states, respectively, where Z a is the partition function for the atoms. But this is not quite 
correct, because in our extension of Einstein's model, the number of photons and the number 
of atoms in a given configuration are strictly correlated, while such a correlation is absent 
if we treat the atoms in equilibrium with an external heat bath, as was done originally by 
Einstein |6] . According to Gibbs, the probability for a configuration that has k atoms in the 
ground state and n — k atoms in an excited stated in thermal equilibrium with a heat bath 
at temperature T is given by 

p G (k) = n a (k)(p g ) k ( Pu r- k . (34) 

Then the mean value of k is given by 

<k> G ='£kP G (k) = (1 + e - e/fcflT) , (35) 

which is equal to k m , and the magnitude of the fluctuations of k is given by 

< Ak 2 > G = $> 2 - < k >l)P G {k) = n {i e + ^ kBT)2 . (36) 

But this result differs from the fluctuations of k obtained by approximating P eq (k) with a 
Gaussian distribution about the mean value k m . In this latter case, one finds that 

I _ d 2 ln(tt a tt p ) _ n + g 



< Ak 2 > d 2 k n g n e n p (g + n p ) ' 
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evaluated at k m = n/(l + e e / fcsT ), which gives 



n (1 + e- £ / fc ^) 

and 

n p (g + n p ) ge hv/k B T 



" --7^-77^ (38) 



(39) 



g ( e hv/k B T _l\2- 

The first term is the same contribution to the mean square deviation, 
< Ak 2 >g, Eq. ESI that is obtained from the Gibb's probability distribution, Eq. OH while 
the second term is the corresponding fluctuation < (An p ) 2 > G that is associated with a gas 
of photon in thermal equilibrium. Hence 

1 + HO 



< (Ak) 2 > < (An g ) 2 > G < (An p y > G 

In Einstein's extended model, the fluctuations in the number of photons can be neglected 
provided that the condition 



< (An g f > G _ (e^ T - 1) 



n 



« 1, (41) 



< (An p ) 2 > G (el k * T + l) 2 g 

is satisfied. For this inequality to be satisfied at all temperatures, it is necessary and sufficient 
that n « g, in which case the photons act as a thermal bath for the atoms. But for the 
temperature T to be determined only by the state of the photon gas, it is also necessary 
that in addition n « n a . 

To show that the equilibrium configuration obtained at the maximum value of the prob- 
ability function P eq (k) corresponds to thermal equilibrium, Boltzmann associated the max- 
imum value of the logarithm of the number of configurations Q with the thermodynamic 
entropy. Setting 

S a = k B ln(n a ) (42) 

and 

S p = k B ln(tt p ) (43) 

for the statistical entropies of the atoms and the photons, respectively, the condition for the 
most probable state of the system, Eq. EH corresponds to the Second law of thermodynamics 
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which states that at equilibrium the total entropy S = S a + Sb of an isolated system is a 
maximum. In this simple model, the entropies S a and S p can be expressed as functions of 
the energies E a = n e e and E p = riphu, respectively, and the temperatures T a and T p for the 
atoms and photons in Einstein's model are then given by the relations 



dS p 1 k Bj r g 



aE p lp hv n p 

Thus the maximum condition for the total statistical entropy leads to the thermodynamic 
condition for thermal equilibrium: 

T a = T p = T. (46) 

We remark that, according to this definition of temperature, the value T a for the atoms is 
not restricted to positive values, because the entropy of the atoms is not a monotonically 
increasing function of the energy E a . For example, T a becomes negative when n g < n e , but, 
as we have shown above, such a condition is not possible for atoms in thermal equilibrium 
with electromagnetic radiation. Thus, under appropriate conditions the photons can act as 
a thermal bath for the atoms, but the atoms cannot provide a thermal bath for the photons. 

From the dynamical point of view developed here, the statistical entropies S a and S p , and 
the energies E a and E p are stochastic variables which vary as a function of time, as is the 
case also for the total entropy S = S a + Sb- This is illustrated in Figs. 1 and 2 which show 
the variation and fluctuations in the energy and entropy as calculated with the absorption 
and emission transition probabilities, Eqs. EI] an El for the case that n = g = n q = 100. In 
these calculations we fixed the unit of time by setting B = 1, and we determined whether 
transitions occur during time intervals 5t = .001 by using a random number generator. 
Notice that in addition to rapid fluctuations in the energy and entropy of the atoms and 
photons there is also a slower and correlated variation associated with an exchange of energy 
and entropy between atoms and photons which appears to oscillate irregularly about the 
most probable value. As expected, the fluctuations in energy and entropy about the mean 
are related approximately by the thermodynamic condition 



5E a = T5S a (47) 
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and 

SE P = T5S P . (48) 

But these conditions are satisfied here only approximately because the total energy E = 
E a + E p is fixed, while the total entropy S — S a + S p is not. Indeed, as shown in Fig. 2, the 
total entropy exhibits fluctuations which are smaller than the separate fluctuations in the 
entropies of the atoms and the photons, and it is bounded from above by the maximum of 
the total entropy. 

IV. The master equation for the time evolution of Einstein's model, and its approach 
to thermal equilibrium 

We consider now the time evolution of Einstein's model when it is initially in an arbitrary 
non-equilibrium state. For example, at t — all the atoms can be in the ground state with 
a number of photons in the cavity, or alternatively, a number of atoms can be in the excited 
state without any photons initially present in the cavity. Introducing a time dependent 
probability function P(k,t), Einstein's transition probabilities for emission and absorption 
of radiation per unit time, Eqs. [TBI and IT4l determine uniquely the probability P(k,t + St) 
at a slightly later time t + St. We follow here the treatment of stochastic variables in van 
Kampen's book [8j . After the small time interval St, the configuration of atoms and photons 
represented by the integer k can arrive at t + St under three different conditions: 

1) At time t there are n g = k + 1 atoms in the ground state, and during the 
time interval St one of these atoms absorbs a photon to make a transition to the 
excited state. 

2) At time t there are n e = n — k + 1 atoms in the excited state, and during the 
time interval St one of the atoms in the excited state emits a photon and makes 
a transition to the ground state. 

3) At time t there are n g = k atoms in the ground state and n e = n — k atoms 
in the excited state, and during the time interval St none of these atoms absorbs 
or emits a photon. 
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FIG. 1: Fluctuations of the energy for atoms (lower curve) and photons (upper curve) in thermal 
equilibrium 

Adding the probabilities for these three mutually exclusive events, we obtain 

P(k, t + 5t) = W(k, k + l)5tP(k + l,t) + W(k, k - l)5tP(k -l,t) 

[1 - ((W(k + l,k) + W(k - 1, k))5t]P(k, t), (49) 



where 



W(k-l,k)=kp a {k) 
15 



(50) 
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FIG. 2: Fluctuations of the entropy for atoms (lower curve) and photons (middle curve) and for 
the total entropy (upper curve) in thermal equilibrium 



and 



W(k+l,k) = (n-k)p e (k), 



(51) 



with the boundary conditions W(-l, 0) = W(0, -1) = W(n + l,n) = W(n, n + 1) = 0. In 
the limit 5t — > 0, one obtains a first order linear differential equation for P(k,t) which can 
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be written in matrix form, 



^M^^W.t), (52) 
k' 

where 

W(k, k) = -k Pa (k) - (n - fc)p e (A;). (53) 

Note that the matrix elements W(k', k) satisfy the condition ^2 k , W(k', k) = 0, as required 
by the conservation of probability relation ^2 k dP(k,t)/dt = 0. 

The condition dP s (k)/dt = for a stationary solution P s (k) of Eq. ["""""is that 

J2w(k,k')P s {k) = 0, (54) 
k' 

which takes the form 

W(k, k + l)P s (k + 1) - W(k + 1, k)P s (k) = 

W(k - 1, k)P s (k) - W(k, k - l)P s (k - 1) = C (55) 

for < k < n, where C is a constant independent of k, and for k = and k = n we find 
that C = 0. Hence, we recover the extended detailed balance equation for the equilibrium 
distribution P eq (k), Eq. [THl and we have P s (k) = P eq {k) 

More generally, the solution of the master equation, Eq. E21 can be expanded in the form 



P(k,t) = P eq (k) + ^ Cj (k)e-^ (56) 

3 

where the coefficients Cj(k) are eigenvectors of the matrix W(k, k') with eigenvalues —Xj, 

J2w(k,k')c J (k') = -X J c J (k) (57) 
k' 

The stationary or equilibrium solution P s (k) is a unique eigenstate of W(k,k') with the 
eigenvalue Ao = 0. It can be shown that the other eigenvalues Xj are positive definite 0, 
and therefore all the solutions of Eq. 152*1 converge to the equilibrium solution. Another proof 
for this convergence is given in Appendix A by constructing an entropy function which 
increases monotonically with time. The length of the eigenvectors Cj is determined by the 
initial conditions P(k, 0). 
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We illustrate the time evolution of the probability function P(k, t) toward the equilibrium 
probability P eq (k), by numerically evaluating the solution of the master equation, Eq. E21 
for two different initial conditions. In Fig. 3 we consider the case when initially there are 
n = 200 atoms in the excited state and no photons, so that n q = 200 with g = 200, and show 
the probability function P(k, t) at the end of each of 10 consecutive time intervals St = .02. 
At time t = .2 the solution has nearly approached the equilibrium solution which according 
to Eq. |^has its maximum at k m = lOOy^- This numerical solution suggests that a very 
good approximation to P(k,t) is a Gaussian function with time dependent parameters for 
the mean value of k and the mean square width (Ak) 2 . This is indeed the will be 

shown in the next section. In Fig. 4 we show the corresponding evolution starting at t — 
with a uniform distribution P(k,0) = 1/n, with the same total energy n q = 200, as in Fig. 
3. In this case the initial evolution is not represented by a Gaussian function, but this form 
is seen to be approached again near the equilibrium. Both cases evolve to the same final 
form because we have chosen initially the same total energy. 



V. Fokker-Planck equation 

Numerical solutions of the master equation, Eq. E21 (see for example Fig. 3) suggests 
that for large values of the parameters n, n Q and g, the probability P(k,t) is a continuous 
function which is well approximated by a Gaussian function with time dependent parameters 
for the mean value of k and the mean square root width Ak. We obtain such an approximate 
solution by assuming that P(k, t) is a different iable function of a continuous variable k, and 
expanding P(k ± Sk, t) to second order in Sk with Sk = 1. Setting 

P ( , ±M)KP(M)± qM) + ^, (58) 
we approximate the master equation, Eq. by the Fokker-Planck equation 

= l-[a(k)P(k,t] + ^[b(k)P(k,t)} (59) 

where 

a(k) = k(k + n ) - (n - k)(g + n Q + k) (60) 



and 



b(k) = -[k(k + n ) + (n - k)(g + n a + k)}, (61) 
18 
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FIG. 3: Time evolution of the probability function P(k, t) at the end of each of 10 consecutive 
time intervals 5t = .02, for g = 200, when initially there are n = 200 atoms in the excite state and 
no photons. 

(we have set B' = 1). For large values of n and k, this equation can be solved approximately 
by assuming that P{k,i) is a Gaussian function, 



P(k,t) 



-{k-k m (t)f /2S(t) 



(62) 
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FIG. 4: Time evolution for the probability function P(k, t) at the end of each of 10 consecutive 
time intervals St = .02, for g and n = 200, when initially P(k, 0) = l/(n+ 1) and n 9 = 200. 

where k m (t) and are time dependent parameters. Then 

dP(k, t) _ . 1 d5 (k - k m ) dk m (k - k m ) 2 d5 

dP(k,t) (k-k. 



dk 



P(k,t), (64) 



d 2 P(k,t) 1 (k-k m ) 2 



[~T+ V (65) 



<9A; 2 (5 <5 2 
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Substituting this expression in the Fokker-Planck equation, Eq. and equating the coeffi- 
cients of (k — k m y for j = 0, land2, we obtain first order nonlinear differential equations for 
k m (t) and S(t). Neglecting a term db{k)/dk which is of order 1/n, we obtain for the j = 1 
terms, 



= -a(Ut)), (66) 

while for the j = and j = 2 terms we obtain the same equation -a consistency requirement 
for the validity of our Gaussian ansatz-, 

d6(t) 
~~dl 

where 



+ 2a , (k m (t))5(t)=2b(k m (t)), (67) 



a >^ = ^) =±k + 2n -g-n. (68) 

These two equations can also be obtained from the master equation, Eq. E21 by evaluating 
the time derivatives of the averages k m (t) =< k > and 5(t) =< (Ak) 2 >, assuming that the 
probability function P(k,t) is sharply peaked at k = k m (t). 

Assuming that initially we have k = k m (0), where < k m (0) < n, the solution of Eq. 
is given by 



(k+ - k_<be~ xt ) 



where 



(Mo) - k+) 

0= (MO)-M' (70) 

A = v /(n-2n -g) 2 + 8n{n + g), (71) 



and 



k± = ^(n-2n -g±\). (72) 

Here time is measured in units of 1/B', and in the limit At >> 1 we see that k m approaches 
k + , which is equal to the most probable value of k at equilibrium obtained previous, Eq. EU 
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The solution for S(t), Eq. |H3 where initially 6(0) = 6 Q , is given by 

5 (t) = I e -«*) f dt'e^b(k m (t')) + 5 e~W (73) 



n 

where 



m = ~ f dt'a'(k m (t')). (74) 



n 



o 



For At >> 1, we have ~ 2 At and <5(t) approaches the equilibrium value 

= 6(fc + ) = £; + (n -g) +n(g + n Q ) 

a'(Jfc + ) 2(4A;+ + 2n + #-n) ' 1 ' 

which can be shown to correspond to the value for < (Ak) 2 > at equilibrium, Eq. 1571 
obtained previously. 

In the limit that both n and g are much larger than n, the changes in the numbers 
of photons in the cavity can be neglected in the expression for the probabilities for the 
absorption and emission of photons, Eqs. EI] and El and we have 

p a w B'n (76) 

and 

p e ^B'(g + n ) (77) 

In this case the photons act as a heat bath for the atoms at a temperature determined by g 
and n , where T = {l/hv)ln(g/n + 1). In this limit, the time dependent solution, Eqs 
and[721 simplifies to the form 



k m (t) = np + (fc m (0) - np)e- xt (78) 



and 



S(t) = - e~^) + (1 - e A)(M5) _ p)e -A* ( i _ e -A t)]> (79) 

where A = n (e hu ' kBT + 1) and p = 1/(1 + e~ hv / kBT ) is the canonical probability of finding 
an atom in the ground state at temperature T. 

For systems in contact with a thermal bath, our model explains the puzzle that a ratio 
of transition probabilities like p e /p a ,which is determined by the underlying dynamics of the 
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system, can also be expressed in terms of the canonical Gibbs probability function, which 



depends on the temperature of the heat bath [17(. Indeed, as we have shown here, the 
temperature of the heat bath is determined by the magnitude of this ratio. In this limit 
we find that Enstein's model, in the version discussed here, corresponds mathematically to 
the Ehrenfests 'dog-flea" model [lsj ]. which was extended recently to finite temperatures by 



Ambegaokar and Clerk Hence Eqs. I7S1 and IT9~1 provide also an approximate analytic 
solution for this model, which previously had been solved by M. Kac |l9j only for the special 
case that p = 1/2 or infinite temperature. 



VI. Summary 

We have shown that a stochastic treatment of a simplified version of Enstein's 1916 model 
for atoms in interaction with photons, which conforms with modern quantum electrodynam- 
ics, serves to illustrate various aspects of the foundations of statistical mechanics. From the 
underlying quantum dynamics of this model we obtained directly the equilibrium probabil- 
ity distribution P eq in accordance with the familiar results obtained in statistical mechanics. 
For atoms treated as distinguishable entities, we found that this equilibrium probability is 
proportional to the number of configurations associated with Boltzmann's statistics, while 
for atoms which obey the Pauli exclusion principle, the corresponding statistics is Fermi- 
Dirac, and for photons it is Bose-Einstein. Conventionally, these probability distributions 
are derived in statistical mechanics by using a postulate introduced by Boltzmann |j| in 
1877, which states that at equilibrium all the microstates of a system at a fixed energy - a 
micro canonical ensemble in the language of Gibbs Q|- are equally probable. 

For the time evolution of the Einstein model we discussed a master equation which 
describes the approach of the probability distribution to a unique stationary solution which 
corresponds to the equilibrium distribution, starting from any arbitrary initial state. In 
the Fokker-Planck approximation we obtained an analytic solution of this equation which 
is in excellent agreement with the numerical solutions some of which are presented here. 
Associated with this probability function we described an entropy function which increases 
monotonically in time reaching a maximum value at the thermal equilibrium distribution. 

We must add, however, an important caveat. In quantum mechanics a state of an isolated 
system can be described by a wavefunction, and at any time t when there are atoms in both 
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the ground state and the excited state, as well as photon states, this wave function is a linear 
combination of wave functions describing these states. Therefore transition probabilities, 
which are obtained from bilinear terms of this wavefunction, contain interference terms that 
have been ignored here. In the literature this is known as the random phase approximation 
or decoherence, but there is no consensus as how to justify this approximation from first 
principles, and a deeper understanding is lacking. Moreover, there is the famous problem 
with the measurement process associated with the Copenhagen interpretation of quantum 
mechanics. Such a process which is indicated by the application of transition probabilities 
repeated here ad infinitum during short intervals of time St, is obviously not taking place 
in a macroscopic system that is evolving towards thermodynamic equilibrium, unless one 
wants to believe that there is a Maxwell-like demon who is continuously carrying out such 
measurements. In our view, however, the success of the detailed balance approach described 
here justifies the application of the Copenhagen interpretation to transition probabilities per 
unit time also in the absence of any identifiable measurement process and/or the existence 
of an observer. 

From a historical perspective , it is interesting to speculate that Einstein, who was the 
master of fluctuation theory, could also have carried out calculations similar to the ones 
we have done here, thus resolving early-on the bitter conflicts which exist (ed) concerning 
the statistical approach to thermal equilibrium proposed by Boltzmann, for systems obey- 
ing W-symn.etric dynannc, Recently, A m begaoka r and Clerk Q disced the 1906 
"dog- flea" model the Ehrenfests which provided an early model to illustrate Boltz- 
mann's ideas. In a special limit, we have shown that the extension of this model to finite 



temperatures is mathematically equivalent to Einstein's model for atoms interacting 
with radiation, when the atoms have only two levels. An analytic solution for the original 
Ehrenfests' model was not obtained until 1947 by Kac [3], and we have now also obtained 
an analytic solution, in the Fokker-Planck approximation, Eqs. EE1 and E01 for the finite 
temperature extension of this model [^J. 

Appendix A. Entropy 

We discuss the definition of entropy and its evolution in time when Einstein's model is 
not initially in equilibrium. It would appear that a natural extension for entropy is the 
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quantity ^2 k P(k,t)lnQ(k), but this expression does not have the desired property that the 
entropy increase monotonically with time. Instead, this property is satisfied by a related 



expression 



21] 



In the case that P(k, t) is sharply peaked at some value k(t), as we have found when P(k, t) 
approaches the equilibrium distribution P eq (k), the term 

-^2P(k,t)lnP(k,t) (81) 
k 

is small compared to 

J2P(k,t)lntt(k). (82) 
k 

In turn, this term can then be approximated by lnQ(k(t)), and we have for the entropy S(t), 

S{t) « lnQ(k{t)). (83) 
Applying the master equation, Eq. E21 to the definition for entropy, Eq. |HU1 we obtain 

Substituting the relation 

W(k,k) = -(W(k + l,k)-W(k-l,k), (85) 

and setting 

z{k ' t) ~ n(ifc + i) ( 5 



we obtain 

dS(t) 
dt 



J2l W ( k + !> fc ) P ( A; ' *) - k + l ) p ( k + t)}lnZ(k, t). (87) 



Substituting the relation 



W(k, K + l)fi(jfe + 1) = W(ife + 1, fc)fi(fc), (88) 
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we obtain 

dS(t) 
dt 

which proves that 



w ( k + 1, k)Q(k)Z(k, t)lnZ(k, t), (89) 



> . (90) 

dt ~ v 1 

Thus, the entropy defined in EqJHU] increases monotonically towards a maximum value 
corresponding to thermal equilibrium. Recently proposed generalizations of this form of the 
entropy j3| are incompatible with this fundamental requirement. 
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